Generating Visual Sensing Strategies in Assembly Tasks

It is generally very di cult, if not impossible, for a robot to perform ne manipulation tasks without the bene t of some form of sensory feedback during actual task execution. As a result, sensing planning is an important component in assembly task planning. This paper describes a method of generating visual sensing strategies based on knowledge of the task to be performed. The generation of the appropriate visual sensing strategy entails knowing what information to extract and where to get it. This is facilitated by the knowledge of the task, which describes how objects are assembled. This knowledge, coupled with known sensor modeling, results in an abstract template of sensing strategy called the sensing task model. By instantiating the appropriate sensing task model at planning time, the sensing strategy is e ciently generated. Our method has been implemented using a laser range nder as the sensor. Experimental results involving typical assembly tasks show the feasibility of the method.